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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address — 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 

THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136 (a). In no event, however, may a reply be timely filed after SIX (6) MONTHS from the 
marling date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timety filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to communication(s) filed on Jul 14, 2003 



2a)5<l This action is FINAL. 2b) □ This action is non-final. 

3) n Since this application is in condition for allowance except for fornnal matters, prosecution as to the merits is 

closed in accordance with the practice under £xparre Quayle, 1935 CD. 1 1; 453 O.G. 213. 

Disposition of Claims 

4) 5<l Claim(s) 1, 3, 29, 31, 38, and 43-48 is/are pending in the application. 



4a) Of the above, claim(s) 
5)D Claim(s) 



6)K Claim(s) 1, 3, 29, 31, 38, and 43-48 

?)□ Claim(s) 

8) □ Claims 



is/are withdrawn from consideratio 

is/are allowed. 

is/are rejected. 

is/are objected to. 



are subject to restriction and/or election requirement 



Application Papers 

9)0 The specification is objected to by the Examiner. 



1 □)□ The drawing(s) filed on 



is/are accepted or tfi] objected to by the Examiner. 



Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

1 1 )□ The proposed drawing correction filed on is: dSJ approved iffl disapproved by the Examine 

If approved, corrected drawings are required in reply to this Office action. 

1 2) 0 The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 119 and 120 

13) D Acknowledgement is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f|. 
a)n All b)n Some* c)U None of: 

1 . □ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 



3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
*See the attached detailed Office action for a list of the certified copies not received. 

1 4)0 Acknowledgement is made of a claim for domestic priority under 35 U.S.C. § 1 1 9(e|. 

ajD The translation of the foreign language provisional application has been received. 

1 5)0 Acknowledgement Is made of a claim for domestic priority under 35 U.S.C. § § 1 20 and/or 1 21 . 
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DETAILED ACTION 

Response to Arguments 

1. Applicant's arguments with respect to claims 1, 3, 29, 31, 38, 43-48 have been considered 
but are moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the prior 
art are such that the subject matter as a whole would have been obvious at the time the invention was made 
to a person having ordinary skill in the art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

3. Claims 1-3, 38, 43, 44, 47 and 48 are rejected under 35 U.S.C, 103(a) as being 
unpatentable over Hashimoto (U.S. 4,768,085) in view of Lee at al. (U.S. 6,466,265). 

Regarding claim 1, Hashimoto '085 discloses a color imaging system providing on-the- 
fly color interpolation using analog signals to reconstruct colors during sensor readout (Fig. 3, 
col. 3, lines 55-68), the imaging system comprising: 

an array of pixel sensor elements wherein at least part of the array is arranged in rows and 
columns (Fig. 1; col. 3, lines 40-f-); 
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a color filter including a plurality of color filter components organized in a predefined 
pattern, the color filter overlaying at least a portion of the array (i.e., noted fi-om Figs. 1 and 4 
that the color filter components are organized in a predefined pattern); 

a readout control circuit coupled to the array (i.e., noted the element 2a as shown in Fig. 
2; col. 4, lines 5+); 

an array controller coupled to the array (i.e., see Fig. 2; col. 4, lines 5+); 

wherein the readout control circuit (2a) and the array controller (2a, 2al and 2a2) are 
configured to simultaneously read out values for a group of pixel elements fi"om two different 
rows and two pixel elements fi^om two different columns (i.e., Figs. 2, 7 and 12; col. 3, fines 54+, 
and col. 5, lines 60+) and 

to reconstruct color components for at least a first pixel sensor element and a second pixel 
sensor element using color information (i.e., noted that the G signal is reconstructed fi-om the 
pixels' signals such as Gl and G2 as shown in Figs. 2 and 3) fi-om other pixels elements (i.e., 
noted the pixel elements nH/mH as shown in Fig. 1) within at least the first portion of the array 
while the readout control circuit is reading said first portion of the array (i.e., col. 4, lines 20+ 
and col. 5, lines 1+). 

Furthermore, it is noted that although Hashimoto '085 shows the use of a plurality of 
color amplifiers (i.e., noted fi-om Fig. 3 that each of the amplifiers 3, 4 and 5 are corresponding to 
one the colors of light), Hashimoto '085 does not explicitly state that the amplifier has a 
programmable gain as recited in the present claimed invention. 
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However, the above-mentioned claimed limitations are well-known in the art as 
evidenced by Lee '265. In particular, Lee '265 teaches in order to achieve high pixels output rate 
for high frame rates, it is conventionally well-known in the art to use a pluraHty of color 
amphfiers (i.e., noted the amplifiers 92 and 93 as shown in Figs. 2e, 4 and 5) each corresponding 
to one of the colors (i.e., noted the R, G and B color signals read out from the pixels 1, 2, 3 and 4 
as shown in Fig. 2b) of Ughts wherein each of the color amplifiers has a programmable gain (i.e., 
col. 4, lines 25+, col. 5, lines 25+; Figs. 4 and 5). 

In view of the above, having the system of Hashimoto '085 and then given the well- 
established teaching of Lee '265, it would have been obvious to one having ordinary skill in the 
art at the time the invention was made to modify the system of Hashimoto '085 as taught by Lee 
'265, since Lee '265 states at col. 1, lines 50+ that such a modification would achieve high pixels 
output rate for high frame rates thereof 

Regarding claim 3, Hashimoto '085 discloses wherein the readout control circuit is 
adapted to perform color interpolation using two pixel sensor elements read out in parallel (i.e., 
col. 3, lines 60+ and col. 6, lines 14+). 

Regarding claim 43, it is noted that Hashimoto '085 does not explicitly states the use of 
CMOS Sensor, however, Lee '265 teaches that it is conventionally well-knwon in the art at the 
time the invention was made to use CMOS sensors in order to realize either high frame rate or 
high pixel count thereof (i.e., see col. 1, lines 25-55 of Lee '265). In view of this, it would have 
been obvious to one having ordinary skill in the art at the time the invention was made to modify 
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the system of Hashimoto '085 as taught by Lee '265, since Lee '265 states at col, 1, lines 50+ 
that such a modification would achieve high pixels output rate for high frame rates thereof 

Regarding claim 44, although Hashimoto '085 shows the use of color filter components 
(i.e., col. 4, lines 5+ of Hashimoto '085), Hashimoto '085 does not explicitly state the use of a 
Bayer pattern color filter as recited in the present claimed invention. 

However, Lee '265 teaches that it is conventionally well-knwon in the art at the time of 
the invention was made to use a Bayer pattem color filter as recited in the present claimed 
invention (i.e., col. 3, lines 20+ of Lee '265). In view of this, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to modify the system of 
Hashimoto '085 as taught by Lee '265, since Lee '265 states at col. 1, lines 50+ that such a 
modification would achieve high pixels output rate for high frame rates thereof 

Regarding claim 38, Hashimoto '085 discloses a color imager (i.e.. Figs. 3, 5, 8 and 10) 
comprising: 

a first light sensor which generates a first analog output signal related to the amount of a 
first color of hght sensed (i.e., noted the sensor of the sensor 2 of the imager generates the first 
analog output signal such that the green signal Gl as shown in Fig. 8 and 9; see col. 6, lines 10+); 

a second light sensor which generates a second analog output signal related the amount of 
said first color of light sensed (i.e., noted the sensor of the sensor 2 of the imager generates the 
first analog output signal such that the green signal G3 as shown in Fig. 8 and 9; see col. 6, lines 
10+); 
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a third light sensor (i.e.. The Blue sensor of the sensor 2) which generates a third analog 
output signal related to the amount of a second color of light sensed (i.e., noted the sensor of the 
sensor 2 of the imager generates the third analog output signal such that the blue signal B2 as 
shown in Fig. 8 and 9; see col. 6, lines 10+); 

a fourth light sensor (i.e., The Red sensor of the sensor 2) which generates a fourth analog 
output signal related to the amount of a third color of hght sensed (i.e., noted the sensor of the 
sensor 2 of the imager generates a fourth analog output signal such that the red signal R as shown 
in Fig. 8 and 9; see col. 6, lines 10+); 

a circuit configured to read out the first, second, third, and fourth analog values at the 
same time (i.e., col. 3, lines 55-68 and col. 5, lines 60+); and 

an interpolation circuit configured to receive said first output signal and said second 
output signal (i.e., col. 3, lines 55+), wherein said interpolation circuit provides an interpolation 
signals on the fly based on at least said first analog output signal and said second analog output 
signal (col. 6, lines 5+). 

Furthermore, it is noted that although Hashimoto '085 shows the use of a plurality of 
color amplifiers (i.e., noted fi-om Fig. 3 that each of the amphfiers 3, 4 and 5 are corresponding to 
one the colors of light), Hashimoto '085 does not explicitly state that the amplifier has a 
programmable gain as recited in the present claimed invention. 

However, the above-mentioned claimed limitations are well-known in the art as 
evidenced by Lee '265. In particular, Lee '265 teaches in order to achieve high pixels output rate 
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for high frame rates, it is conventionally well-known in the art to use a plurality of color 
amplifiers (i.e., noted the amplifiers 92 and 93 as shown in Figs. 2e, 4 and 5) each corresponding 
to one of the colors (i.e., noted the R, G and B color signals read out from the pixels 1, 2, 3 and 4 
as shown in Fig. 2b) of lights wherein each of the color amplifiers has a programmable gain (i.e., 
col. 4, lines 25+, col. 5, lines 25+ ; Figs. 4 and 5). 

In view of the above, having the system of Hashimoto '085 and then given the well- 
established teaching of Lee '265, it would have been obvious to one having ordinary skill in the 
art at the time the invention was made to modify the system of Hashimoto '085 as taught by Lee 
'265, since Lee '265 states at col. 1, lines 50+ that such a modification would achieve high pixels 
output rate for high frame rates thereof. 

Regarding claim 47, please see the Examiner's comments with respect to claim 43 as 
discussed above. 

Regarding claim 48, please see the Examiner's comments with respect to claim 44 as 
discussed above. 
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4. Claims 45 is rejected under 35 U.S.C. 103(a) as being unpatentable over Hashimoto '085 
in view of Lee '265 as applied to claims discussed above, and further in view of Wilder et al. 
(U.S. 5,262,871). 

Regarding claim 45, although the combination of Hashimoto '085 and Lee '265 teaches 
the use of a control circuit is programmed to selectively reading groups of pixel elements to 
create a color reconstruction (i.e., noted Figs. 1 and 2 of Hashimoto '085; and Figs. 2a-3b of Lee 
'265), the combination of Hashimoto '085 and Lee '265 does not explicitly state that the readout 
control circuit is programmed to selectively skip some of the groups of pixel elements to create a 
lower resolution. 

However, the above mentioned claimed limitations are well-knwon in the art as 
evidenced by Wilder '871 . In particular. Wilder '871 teaches that it is conventionally well- 
known in the art at the time of the invention was made to program the readout control circuit 
(i.e., noted the readout control circuit as shown in Fig. 1 of Wilder '871) for the purpose of 
selectively skip some of the groups of pixel elements to create a lower resolution image(i.e., i.e., 
noted that the groups of pixel elements as shown in Figs. 2 may be selectively skipped during the 
specific resolution mode as discussed in col. 6, lines 50+; see col. 3, lines 20+ and col. 6, lines 
2+ of Wilder '871). 

In view of the above, having the combination of Hashimoto '085 and Lee '265 and then 
given the well-established teaching of Wilder '871, it would have been obvious to one having 
ordinary skill in the art at the time the invention was made to modify the system of Hashimoto 
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'085 as taught by Wilder '871, since Wilder '871 states at col. 2, lines 50+ that such a 
modification would achieve high speed data capture rate for high frame rates thereof. 

5. Claims 29, 31 and 46 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Maenaka et al. (U.S. 5,555,023) in view of Lee at al. (U.S. 6,466,265). 

Regarding claim 29, Maenaka '023 discloses a method of interpolating color components 
of an array of pixel sensor elements (col. 3, lines 40+ and col. 6, lines 45+), said method 
comprising: 

reading a first rectangular portion of an array of pixel sensor elements simultaneously, 
wherein the first rectangular portion includes pixel sensor elements from at least two array 
columns and two array rows (i.e., Fig. 8; col. 1, lines 45-50, col. 2, lines 45+); 

reading a second rectangular portion of the array of pixel sensor elements, wherein the 
second portion partly overlaps said first portion (i.e.. Fig. 8; col. 1, lines 45+ and col. 2, lines 
45+); and 

reconstructing color components using interpolation for at least a third portion of the 
array while said third portion of the array is being read (i.e.. Figs. 2 and 8-9; col. 2, lines 35+, col. 

6, lines 35+ and col. 7, lines 20+). 

Furthermore, it is noted that Maenaka '023 does not explicitly states the use of CMOS 
Sensors, however, Lee '265 teaches that it is conventionally well-knwon in the art at the time the 
invention was made to use CMOS Sensors in order to realize either high frame rate or high pixel 
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count thereof (i.e., see col. 1, lines 25-55 of Lee '265). In view of this, it would have been 
obvious to one having ordinary skill in the art at the time the invention was made to modify the 
system of Maenaka '023 as taught by Lee '265, since Lee '265 states at col. 1, lines 50+ that such 
a modification would achieve high pixels output rate for high frame rates thereof 

Regarding claim 31, Maenaka '023 discloses wherein reconstructing color components 
(i.e., the R, G and B signal as shown in Fig. 8) using interpolation is performed in real-time (i.e., 
noted the color components are interpolated as read out from the CCD sensor in real-time as 
claimed). 

Regarding claim 46, although Maenaka '023 shows the use of color filter components 
(i.e.. Fig. 8 of Maenaka '023), Maenaka '023 does not explicitly state the use of a Bayer pattern 
color filter as recited in the present claimed invention. 

However, Lee '265 teaches that it is conventionally well-knwon in the art at the time of 
the invention was made to use a Bayer pattern color filter as recited in the present claimed 
invention (i.e., col. 3, lines 20+ of Lee '265). In view of this, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to modify the system of 
Maenaka '023 as taught by Lee '265, since Lee '265 states at col. 1, lines 50+ that such a 
modification would achieve high pixels output rate for high frame rates thereof 
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Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

a. Zamowski '198 and Parulski *894 shows a color imaging system having CMOS sensor 
for providing a color image signal thereof 

b. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
AppUcant is reminded of the extension of time poHcy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action, hi the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 
1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, 
will the statutory period for reply expire later than SIX MONTHS from the date of this final 
action. 

7. Any response to this final action should be mailed to: 
Box AF 

Commissioner of Patents and Trademarks 
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Art Unit: 2612 



Washington, D.C. 20231 



Or Faxed to: 



(703) 872-9314, (for formal communications; please mark "EXPEDITED 
PROCEDURE"; and for informal or draft communications, please label 
"PROPOSED" or "DRAFT"). 

Hand-delivered responses should be brought to Crystal Park n, 2121 Crystal Drive, 
Arlington, VA., Sixth Floor (Receptionist). 



Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Aung S. Moe whose telephone number is (703) 306-3021. The examiner 
can normally be reached on Monday-Friday from 9:00 A.M. to 5:00 P.M. 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's 
supervisor, Wendy Garber, can be reach on (703) 305-4929, 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the customer service number (703) 306-0377. 



A. Moe 



September 16, 2003 




